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Abstract 
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miting  distributions  of  square-integrable  infinite  order  U-statistics 
were  first  studied  by  Dynkin  and  Mandelbaum  (1983)  and  Man 
delbaum  and  Taqqu  (1984).  We  extend  their  results  to  the  case  of 
non-Poisson  random  sample  size.  Multiple  integrals  of  non-Gaussian 
generalized  fields  are  constructed  to  identify  the  limiting  distribu¬ 
tions.  An  invariance  principle  is  also  established. 

We  use  these  results  to  study  the  limiting  distribution  of  the  amount 
of  charge  left  in  some  set  by  an  infinite  system  of  signed  Markovian 
particles  when  the  initial  particle  density  goes  to  infinity.  By  se¬ 
lecting  the  initial  particle  distribution,  we  determine  the  limiting 
distribution  of  charge,  constructing  different  non-Gaussian  general¬ 
ized  random  fields,  including  Laplace,  a-stable,  and  their  multiple 
integrals. 
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1  Introduction 


This  paper  pursues  two  objectives:  to  study  the  asymptotic  behaviour  of  symmetric 
statistics  with  random  sample  size,  and  to  apply  the  resulting  limit  theorems  for  U 
statistics  to  study  the  asymptotic  behaviour  of  infinite  particle  systems  with  random 
non-Poisson  initial  distribution.  Our  main  result  is  Theorem  1,  which  describes  the 
asymptotic  distribution  of  U-statistics  in  terms  of  multiple  integrals  of  a  non-Gaussian 
process,  whose  distribution  is  determined  by  the  choice  of  the  distribution  of  the 
sample  size.  The  construction  of  these  integrals  is  given  in  Sections  2  and  3  of  the 
paper.  One  motivation  for  studying  statistics  with  random  size  is  that  it  is  not  always 
possible  to  take  a  fixed  number  of  measurements.  In  queueing  theory,  reliability,  and 
sequential  analysis,  study  of  statistics  with  random  size  goes  back  to  the  works  of 
Renyi  (1956),  Robbins  ( 1948a, b),  Gnedenko  and  Fahim  (1965)  (see  also  the  survey 
Gnedenko  (1983)  and  the  recent  monographs  Lee  (1990),  Kruglov  and  Korolev  (1990) 
and  Rachev  (1991)).  The  rest  of  the  introduction  motivates  the  study  of  infinite 
particle  systems  with  non-Poisson  initial  distribution.  Thus,  readers  who  are  not 
interested  in  this  second  problem  should  skip  directly  to  Section  2  of  the  paper. 

In  recent  years  much  attention  has  been  given  to  the  description  of  infinite  systems  of 
particles  moving  according  to  some  law  (usually  Markovian).  Among  these  are  works 
by  Snitzman  (1984),  Shiga  and  Tanaka  (1985),  Walsh  (1986),  Adler  and  Epstein 
(1987),  Adler  (1989,  1990),  Epstein  (1989),  Adler,  Feldman  and  Lewin  (1991),  and 
others. 

Many  of  these  papers  deal  with  particle  systems  which  behave  as  follows:  Initially  (at 
time  zero)  a  number  of  independent  particles  pop  into  existence  at  locations  within 
the  space  according  to  a  Poisson  point  process  with  intensity  A.  The  particles  then 
move  about  according  to  some  Markov  law.  The  asymptotic  behaviour  of  this  system 
as  A  — ►  oo  has  been  studied  in  Martin-Lof  (1976),  Ito  (1983),  Walsh  (1986,  Ch.8), 
Adler  and  Epstein  (1987),  Adler  (1989,  1990),  Adler,  Feldman  and  Lewin  (1991)  for 
different  conditions.  In  particular,  Adler  and  Epstein  (1987)  obtain  convergence  of 
sums  of  some  functionals  of  the  Markov  processes  to  generalized  Gaussian  random 
fields  and  their  functionals.  The  authors  show  how  these  limit  theorems  can  be  used 
to  study  properties  of  the  limiting  random  fields. 

The  question  we  ask  in  this  paper  is,  “What  happens  to  a  Markovian  particle  system  if 
we  change  the  initial  distribution  of  the  particles?”  When  the  Cent  ral  Limit  Theorem 
is  applied  to  a  sum  of  N  i.i.d.  random  variables,  non-Poisson  randomization  of  the 
sample  size  N  leads  to  non-Gaussian  limits  (see,  for  example,  Rachev  (1991),  Section 
19).  The  choice  of  a  non-Poisson  initial  distribution,  e.g.,  geometric  or  “discretized” 
o-stablc,  produces  non-Gaussian  generalized  random  fields  as  limits  of  sums  of  some 
functionals  of  Markov  processes,  and  this  construction  provides  a  tool  for  the  study 


of  t  Ik  'sr  fields. 


Note  that  the  limiting  distributions  which  we  obtain  have  main  practical  apple  a 
tions.  Laplace  processes,  which  can  be  generated  via  a  geometric  summation  scheme, 
are  used  in  reliability  (Brown  (1990),  Gertsbakh  (1990)),  in  environmental  studies 
( Raehov  and  Todorovich  (1991)),  and  in  modeling  of  financial  data  (Miltnik  and 
Rachev  (1990)).  The  recent  developments  and  applications  of  stable  processes  are 
covered  in  Samorodnitsky  and  Taqqu  (1990),  Rachev  and  Ri'ischendorf  (1990),  etc. 
Blattberg  and  Genodes  (1974)  observed  that  the  t-distribution  provides  a  better  mod 
el  for  “peaky1  distributions  than  the  Gaussian  does.  Melamed  (1989)  studies  the 
generalized  Laplace  distribution.  By  selecting  the  initial  distribution  of  the  particles, 
we  are  able  to  produce  Laplace,  stable,  generalized  Laplace,  “t",  and  other  gener¬ 
alized  random  fields.  Note  that  one-dimensional  time  processes  of  these  types  were 
obtained  in  Mandelbrot  and  Taylor  (1967)  and  Clark  (1973)  and  used  for  modeling 
stock  returns,  providing  better  fits  than  Gaussian  processes  do. 

We  now  describe  several  interesting  ways  in  which  particles  may  be  born  on  Rd ,  d  >  1 . 
Let  R?  be  divided  into  unit  cubes  with  vertices  on  the  lattice  Zd .  On  a  probability 
space  take  a  Poisson  random  variable  N{\)  with  mean  A  >  0.  At  the  initial  time, 
iV(A)  particles  are  born  independently  in  each  cube,  and  are  distributed  uniformly. 
Thus,  at  the  initial  time  we  observe  what  we  will  call  a  “Poisson  picture11  in  Rd . 
Alternatively,  the  particles  could  be  generated  according  to  the  following  scheme: 
Imagine  a  generator  which  at  each  step  remains  active  with  probability  q.  If  active, 
it  produces  one  particle  (uniformly  distributed)  in  each  cube.  The  particles  are  held 
in  the  cubes  where  they  were  born  until  the  time  of  a  “catastrophe11,  a  geometrically 
distributed  moment,  when  the  generator  fails.  At  that  time  particles  become  free  to 
move  over  the  whole  space  It?  according  to  some  Markov  law  until  their  exponential 
lifetimes  expire.  Note  that  the  starting  time  t  =  0  of  the  system  is  the  moment  when 
the  generator  fails.  We  are  interested  in  the  case  where  the  failure  probability  1  —  q 
is  very  small,  in  which  case  the  average  density  of  particles  is  very  large. 

The  geometric  and  Poisson  distributions  both  have  the  property  that  the  probability 
of  a  large  number  i  of  particles  being  born  in  one  cube  approaches  zero  at  an  ex¬ 
ponential  rate  as  x  — ♦  oo.  It  might  be  interesting  to  consider  a  system  in  which  the 
init  ial  particle  density  can  take  very  large  values  with  high  probability.  This  requires 
a  distribution  with  a  heavy  tail.  As  an  example,  we  use  a  “discretized11  version  of  a 
positive  stable  distribution.  Another  interesting  initial  distribution  is  a  mixture  of 
Poisson  distributions.  This  means  that  the  particles  are  generated  by  several  Poisson 
distributions,  one  of  which  might  produce  most  of  the  particles.  We  also  consider 
mixed  empirical  and  doubly'  stochastic  point  process  of  particles,  each  having  finite 
initial  measure. 

following  the  construction  of  Adler  and  Epstein  (1987),  we  shall  assign  a  Rademacher 
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positive  or  negative  charge  to  each  particle,  semi  an  appropriate  parameioi  ><l  1 1 1« ■ 
init  ial  distribution  to  infinity  and  study  the  limiting  distribution  of  charge  led  by  l  lie 
system  in  a  set  after  all  particles  have  died.  The  limiting  field,  which  is  indexed  by 
sets,  or  more  generally,  by  functions,  will  have  a  non-Gaussian  distribution.  As  special 
cases,  we  obtain  Laplace,  stable,  Gamma,  “t”,  and  other  fields.  We  also  construct 
their  functionals  using  limits  of  sums  of  symmetric  functionals  of  the  Markov  processes 
in  the  system. 

This  paper  is  organized  as  follows:  First,  we  develop  some  general  limit  theorems 
for  sums  of  symmetric  functionals  of  independent  random  variables  with  values  in  an 
arbitrary  measure  space  when  the  number  of  summands  is  random.  For  fixed  and 
Poisson  sample  size,  such  theorems  were  proved  by  Dynkin  and  Mandelbaum  ( 1 9ST ) 
and  an  invariance  principle  was  established  by  Mandelbaum  and  Taqqu  (198-1)  in  their 
studies  of  U-statistics.  We  describe  our  generalizations  of  their  results  in  Section  2: 
proofs  are  given  in  Section  3.  In  Sections  4  and  5  we  analyze  the  distribution  of 
charge  left  in  the  space  by  systems  of  Markov  processes  created  under  different  initial 
conditions. 


2  Symmetric  statistics  with  random  sample  size  and  mul¬ 
tiple  integrals. 

This  section  contains  our  results  on  symmetric  statistics,  often  called  U-statistics, 
when  the  number  of  summands  is  random.  Let  X,Xi,X2,. . .  be  i.i.d.  random  vari¬ 
ables  taking  values  in  an  arbitrary  measurable  space  (Af, T)  with  distribution  v .  For 
each  T  >  0,  let  Wt  be  a  space  of  sequences  of  functions  {hk\ k  >  0}  for  which  h0  is  a 
constant,  hk  =  hk{x\, . . .  ,xk)  is  a  symmetric  function  on  Xk  such  that 

IIMIr  :=  £  <  OO, 

k= 0  K- 

where 

:=  J  Jxkhl(xl,...,xk)v(dxl)...v(dxk). 

Let  H  =  rVxjHr.  The  function  lik  will  be  called  canonical  if 

/  hk(xu. . .  ,ik_ux)v(dx)  =  0  j/-1  -  a.(. 

J  A 

Let  {h  k,k  >  0}  be  a  sequence  of  canonical  functions  from  H.  Define  sums 
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for  u  >  /,  and  o^(hk)  (I  otherwise. 

The  limiting  distribution  of  n~kf2o%  as  n  — >  oo  was  studied  by  Dynkin  and  Mandel 
baum  (1983)  (as  well  as  by  other  authors).  They  also  considered  statistics  (1)  for 
Poisson  sample  size,  i.e.  the  limit  as  A  — *  oo  of  A_*/2<7j^A,  where  A'.\  is  a  Poisson  ran¬ 
dom  variable  with  mean  A  >  0  independent  of  A'  | ,  A2 ,  . ..  In  both  cases  Dynkin  and 
Mandelbaum  obtain  the  same  limits,  which  are  written  in  terms  of  multiple  Wiener 
integrals  of  Gaussian  measure  defined  on  (X  ,T). 

For  r  >  0,  let  A ’{r)  be  a  positive  random  variable  taking  integer  values  independent  l\ 
of  the  A,'s  and  such  that 

N(r)/r  Y  as  r  — »  00  f  — ) 

for  some  positive  random  variable  V’  independent  of  A ’s.  We  would  like  to  study  the 
limiting  behavior  of  statistics  r~kf2o^^  as  r  — »  00.  The  limiting  distribution  in  tins 
case  appears  to  be  expressed  via  multiple  integrals  with  respect  to  a  random  measure 
{M{B),B  €  T,v{B)  <  00)  which  has  orthogonal  increments. 

We  will  denote  by  weak  convergence  of  finite  dimensional  distributions. 

The  main  result  of  this  section  is  the  following  theorem: 

Theorem  1.  Let h  =  {h*,  k  >  0}  he  a  sequence  of  canonical  functions  in  H.  Let  Cy 
be  the  Laplace  transform  ofY.  As  r  00  the  finite  dimensional  distributions  of 

Zr(h):=£  r-'W\h„)  13) 

k-0 

converge  to  those  of££l0(l/fc!),/fc(/r*)>  where  Jk  are  multiple  integrals  with  lespcct 
to  a  random  measure  M  on  {X,!F)  such  that  for  sets  B{,...,Bn  f  T  the  vector 
(M(Bi ),...,  A/(Bn))  has  the  characteristic  functional 

Ec,\im(b1)+.  +.km(b„)  =  Cy  ^  £  A.A ,v{Bt  D  Bj) J  -  H  i 

The  construction  of  the  multiple  integrals  Jk  will  be  given  later,  in  the  course  of  the 
proof.  We  will  use  a  technique  which  has  parallel  in  stochastic  analysis,  where  mans 
results  on  continuous  local  martingales  can  be  obtained  via  quadratic  variation  time 
change  from  results  on  Brownian  motion  (see  Revuz  and  Yor  (1991));  our  main  tool 
will  be  a  “random  function  change”  in  the  Wiener  integrals  with  respect  to  Gaussian 
measure,  defined  in  Dynkin  and  Mandelbaum  (1983). 

Before  we  proceed  into  technicalities,  let  us  give  some  examples  of  random  measures 
M  which  correspond  to  different  distributions  of  sample  size  N(r). 
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Example  1.  (Poisson  sample  size).  If  A  (?  )  is  a  Poisson  random  variable  with  mean 
j  >  U,  then  ,V(r)/r  — *  I  and  M  coincides  with  the  Gaussian  measure  {H  (Bj.B  • 
T,v{B)  <  00}  such  that  EW(B)  =  0,EW(A)W(B)  =  v(A  H  B).  This  is  the  case 
considered  by  Dynkin  and  Mandelbaum  (1983)  and  Mandelbaum  and  laqqu  (19.S1). 

Example  2.  (Geometric  sample  size).  Let  N(r)  be  a  geometric  random  variable 
with  mean  r.  Then  Y  is  a  standard  exponential  and  M  is  a  Laplace  random  measure 
{ L(B),B  €  T,i'(B)  <  00}  such  that 

Example  3.  (Mixture  of  Poisson).  Define  A°(r),  j  —  1.2,...,  A",  as  a  sequence 
of  independent  Poisson  r.v’s  with  means  rct:,  a3  >  0,  j  =  1.2.  ...,A\  Consider  a 
mixture  of  Poisson  distributions 

P(JV(r)  =  l)  =  '£pJP(N>(r)  =  l), 
j=i 

where  p:  >  0, £j=i  p:  =  1.  In  this  case  Y  is  a  discrete  random  variable  with  P()  - 
Oj)  =  Pj  arid  the  measure  M  is  a  mixture  of  Wiener  measures  (Kon  (1984)  applies 
such  distributions  to  model  stock  returns). 

Example  4.  (Discretized  stable  sample  size).  Let  Y  be  a  positive  stable  r.v.  with 
Laplace  transform  Ee~XY  =  e-*°/2,A  >  0,  where  the  index  of  V  a/2  is  less  than  1. 
Let  N(r)  be  the  following  discretized  version  of  Y : 

P(N(r)  ~  k)  —  P[k  —  1  <  rY  <  k),  k  >  1  (6) 

Clearly,  (2)  holds  and  the  random  measure  M  is  symmetric  stable  with  parameter  o: 

Ec*hMlBl»...+i\nMiBn)  =  expi  -ll  jr  A, A 

\2  «U  =  ‘ 

Note,  that  the  measure  M  is  different  from  the  stable  random  measures  studied  in 
Weron  (1984)  and  Samorodnitsky  and  Taqqu  (1990),  since  its  increments  are  not 
independent. 

Example  5.  Let  \/Y  be  a  chi-square  r.v.  and  let  A !(r)  be  a  discretized  version  ((») 
of  )  .  For  B  €  T<  M{B)  has  a  t-distribution. 

Example  6.  (Generalized  geometric  sample  size).  Pick  any  m  >  0.  Let  A'(r)  have 
generalized  geometric  distribution  (cf.  Melamed  (1989)) 

/’(A'(r|  =  I  +  km)  =  i  n<!+j)<V"(l  -  ;)*  <ork  >  I 

,=o  r  r  r 
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and  /’(  A  (r )  -j  I  )  •-  r  .  1  lien  V  in  (2)  is  a  Gamma  ( 1  /m,  in  j  <ii<i  i  il  >nle<|  i .  \ .  with 
Laplace  translorm  t.t  v'  =  ( 1  -f  .  M  has  the  distnbut  urn 

(n  \ 

\  +  j  £  A,Aji/(B,  (1  JJj)J  . 

We  now  rigorously  construct  and  characterize  the  random  measure  M  and  its  multiple 
integrals.  For  the  Gaussian  case  this  was  done  by  Dynkin  and  Mandelbaum  (19S3) 
and  extended  to  an  invariance  principle  by  Mandelbaum  and  Taqqu  (1984).  Wo 
proceed  in  steps,  in  order  to  show  how  the  defined  integrals  appear  naturally  in  the 
study  of  the  limiting  distribution  of  Zr(h)  of  Theorem  1. 

On  some  probability  space,  define  a  linear  random  family  {Ji(<p).o  €  L2(r/)}  through 
its  finite-dimensional  distributions  given  by 

Eexp{i\Jx(<t>)}  =  CY  (^AM<^2))  .  (") 

and 

aJ\{4>)  +  —  J^cuf)  -f  bxl>)  a.s.  for  all  a,  b  G  R  (8) 

where  Cy ,  as  before,  is  the  Laplace  transform  of  the  r.v.  Y.  Note  that  although 
*A  =  J\  depends  on  Y,  we  will  suppress  the  index  Y  in  our  notation.  The  family 
is  defined  on  a  probability  space,  which  may  be  different  from  the  one  which  supports 
the  Xi's  and  V”,  but  we  will  use  the  same  sign  for  expectations.  If  we  consider  the 
subfamily 

=  M \B),  But,  u{B)<  oo}, 

then  symbolically 

=  f  <t>{x)M(dx). 

J  X 

Lemma  1  below  shows  the  relationship  between  the  statistics  cr|V<r)  and  the  family 
Let  L  =  {<f>  £  L2(i/)  :  =  0}. 

Lemma  1.  Under  the  conditions  of  Theorem  1, 

(  N{t)  4 

(9) 

l  ■='  Itu 

Our  next  step  is  to  define  an  analog  of  quadratic  variation  of  the  process  J).  As 
is  seen  from  Lemma  2  below,  this  role  will  be  played  by  the  linear  random  family 
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{I\(0)-O  (  //(/')}-  which  is  defined  on  the  same  probability  »o<  <  ■  as  ili<-  familv 

•Vi (</>),  and  whose  joint  distribution  with  J\(<fi)  is  given  by 

E cxp{iXJi(4>)  +  =  Cy  +  -A2/'io2))  •  (1()) 

Here  the  Laplace  transform  Cy  is  defined  on  the  right  half-plane  (Re  z  >  0). 
Lemma  2.  As  r  — *  oo, 


/V(r)  N(r)  > 

r-1/2E^  V.),  r-1  £02(A',) 


{(^1(^)1  A  U'D} 


S'.ve 


(ID 


1=1 


«=i 


<M'€£ 


As  the  next  step,  for  4>  G  L  define  h*  —  1, . . . ,  hf(xi, . . . ,  xk)  =  opr, )  •  ...  ■  <t>{ xk) . 

Then  the  sequence  h *  —  {h*,  k  >  0}  is  in  the  space  7i  ( 7i  was  defined  at  the  beginning 
of  this  section)  and  ZT(h<t‘)  is  well  defined.  We  are  now  ready  to  find  its  limiting 
distribution.  Set 


e(4>)  =  exp{M<t>)-\l<W) 

Lemma  3.  As  r  — >  00 


(12) 


{z^>U  4 


(13) 


Recall  that,  the  defined  function  £  is  a  generating  function  of  generalized  Hermite 
polynomials  which  serve  as  multiple  integrals  (cf.,  Revuz  and  Yor  (1990)).  Specifically, 
let  //*.. ( j- )  be  the  Hermite  polynomial  of  order  k  with  leading  coefficient  1  : 


For  a  >  0.  set 

Hk(x,a)  =  ak'7Hk(x/^). 
We  also  set  Hk{x, 0)  =  xk.  Then, 


£  j jHk(x,a )  =  exp{ux  -  au7  / 2}. 
k= 0  k- 

Recall  that  for  a  real-valued  local  martingale  {At,t  >  0},  Au  =  0.  with  quadratic  vari¬ 
ation  <  A.  A  >,  the  iterated  stochastic  integral  is  defined  via  a  generalized  Hermite 
polynomial: 

h]  ji  dAti  Jo dA”  ’ "  j: ' dAsk  :=  Hk{Au<  a x  >,] 
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(K  <■  vu/  and  3  or,  |>. !  1  5).  Similarly,  define  I  In'  multiple  integral  of  01  dei  k  on  tin  |<a<  e 
of  fund  ions  { h )' ,  6  6  A)  as 


Jk(ht)  ~  Rk(M<f>)J<(<f>))  HI) 

Using  the  last  definition,  linearity  of  the  processes  J\  and  A ,  (12),  and  Lemma  1  we 
obtain 

Lemma  4.  Under  the  conditions  of  Theorem  I, 

ns) 

t*=0  ■ 

as  7*  — *  oo. 

Since  the  space  {h.f,k  >  0, <f>  €  L)  is  dense  in  H,  the  passage  from  Lemma  -1  to 
Theorem  1  is  possible. 

The  proofs  of  Theorem  1  and  Lemmas  1,2,  and  3  will  follow  in  Section  3. 

We  will  extend  the  result  of  Theorem  1  to  an  invariance  principle  for  random  sums 
of  symmetric  statistics,  similar  to  one  obtained  by  Mandelbaum  and  Taqqu  (19S4). 
Let  f  :  R+  —>  R;  <  f,  f  >2:=  /0°°  f2{x)dx  <  oo,  <j>  €  L.  We  extend  the  definition  of 
the  random  integral  to  the  product  space  of  functions  L  x  L2(R+)  by  putting 

Eeip{iXtJrL‘\M,)  +  ■  ■  ■  +  =  (16> 

Cy  <  /•’/>  >2j  • 

(*>,/>)€  LxL\R<). 

Then,  the  random  measure  M  on  the  product  space  x  (/?+ ,  £>(  A4 ),  Ia  b) 

( B(R+ )  is  the  Borel  cr-field  on  positive  half  line)  can  be  defined  as  follows: 

M(B  x  (0, s])  =  B  €  JF,s  >  0. 

On  Xk  x  RK+  define 

hk't(.ru...,.ck,uu...,uk)  :=  . . .  ,r*)l[o.f](ui)  •  •  •  l[o.f)(«0-  (1") 

We  tl  icn  have: 

Theorem  2.  Let  {/;*.,  A  >0}  be  a  sequence  of  canonical  functions  in  7i  As  r  — >  oc. 
the  process 

Z‘(/ >):='jtr-k/2ol?{r)t\hk),  t>  0,  (18) 

k= 0 
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converges  weekly  in  D|U,oc)  to 


M\h):.=  £^jrLeb(^,),  d'>) 

k=0  K- 

where  the  multiple  integrals  are  taken  with  respect  to  the  random  measure  M  on  the 
product  space  x  (R+,B(R+),  Leb)  defined  above. 

Symbolically, 

Jl*L,b(l>ka)  —  J  hk(x  i, . . . ,  Xk)  l[o,f](wi)  •  •  ■  1  [o,«J  ( w* )  A/  (  </j-  i ,  dvt)  .  .  .  M(d:rk,dvk). 

where  the  integral  is  taken  over  the  product  (A!  x  R+)k. 

3  Proofs  of  Theorems  1  and  2. 

Let  <j) ,  V’n  V’2i  •  •  •  be  functions  in  L. 

Proof  of  Lemma  2.  Consider  the  2k-dimensional  process 

(Ut)Mt))  := 

t=i 

£  :=  (MXi **(*)),  £2  :=  (0?(X, V^( A',)) 

on  D[0,oo). 

from  Donsker  s  invariance  principle,  the  law  of  large  numbers  and  Theorem  4.4  on 
p.  27  of  Billingsley  (1968)  follows  the  weak  convergence  of  {G-'b)-  as  r  -*  oo,  to  a 
2k-dimensional  process  G such  that 

Etxp  {?(A >/£)GW)(0}  =  exp  J  itj^  ^  53 

l  i=i  z  <j=i 

A  =  p  =  {pu...,pk) 

From  (2)  and  the  independence  of  Af(r)  and  the  A\’s,  it  follows  that  (Af(r)/r,  ((r,  r/ r)) 
converges  weakly  to  (V,  G(<M))). 

By  the  Skorohod- Dudley  theorem  (cf.,  Dudley  (J989),  Theorem  11.7.2),  there  ex 
ists  a  probability  space  rich  enough  to  support  random  pairs  (,Y(r)/r,  (£.,T/r))  and 
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0  '  ^  having  the  same  (list  rihution  as  ( ,\  ( r  i  /  /.(£,;/,))  and  ( 1  • 1 i)  ■  i  rspo 

I  ivcly.  and  such  t  hat. 


d 


,G 


0  a.s. 


where  d  is  the  Skorohod  metric  in  Z)[0, oo)  (see  Resnick  (19S7),  p.  221,  Racliev  and 
Riischendorf  (1990)). 


Then, 


( >  ) 


This  immediately  gives  the  result  of  Lemma  2. 

Proof  of  Lemma  1.  Lemma  1  follows  immediately  from  Lemma  2  when  <,>  =  0. 
Proof  of  Lemma  3.  For  any  <j>  €  L, 

(N(r) 


N(  r)  \ 

logZr(h *)  =  log  (  n(1+r",/2^^.))j 


1  ^(r)  \  "Vrl 


N(r) 


2  r  j 


i=i 


{°<t>  -^Oasr-t  oo.)  In  other  words  the  field  {log  Zr(h?)  j  ^  has  the  same  limiting 

distribution  (in  the  sense  of  weak  convergence  of  finite  dimensional  distributions)  as 
the  field 

N{ r)  1  N(t) 


l  "V)  1  lyKT) 

-s  E  *(*.)  -jrE  *’(*) 

>/r  j=i  2r 


Applying  Lemma  2  to  the  latter  field  we  obtain  its  convergence  to  {  -  |/\'(c!>)} 

This  proves  Lemma  3. 

Lemma  4  was  obtained  in  Section  2.  We  shall  now  prove  Theorem  2;  Theorem  1  will 
follow  from  Theorem  2  when  t  =  1. 


Proof  of  Theorem  2.  On  an  arbitrary  measurable  space  (,V',JF',  i/),  define  a  Claus 
sian  family  {/,(<£),<£  e  L2(A")}  with 


£/,(<£)  =  0;  £/,(*)/,(*)  =  «/(<W). 

The  multiple  Wiener  integral  of  order  k  associated  with  the  Gaussian  family  L  is  de¬ 
fined  as  a  linear  mapping  Ik  from  the  space  Hk  of  symmetric  functions  /^(.r,, . . . ,  .rk), 
WHhl)  <  °°,  into  the  space  of  functionals  of  the  Gaussian  family  / |.  The  mapping 
is  uniquely  defined  by  the  following  conditions  (cf. ,  Dynkin  and  Mandelbaum  (19S3)): 
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A.  Ik(l't)  =  /4(/„»/(^2)),  £  />2(.V'). 

B.  For  hk  e  El l(hk)  =  k\(,/)k(k2). 

For  {hk,  k  >  0}  €  ~H  define  the  multiple  Wiener  integral  of  the  function  hk  l  (likJ  was 
defined  in  ( 1 7)).  The  integral  is  defined  on  the  product  space  (A",  T\  v')  —  (.Y, /",//)  x 
(/{+,  B(R+),  Leb)  and  is  associated  with  the  Gaussian  family  {I\*Lcb{<f>f),(4>,.f)  € 
L2(A’)  x  L2(R+)},  which  has  mean  zero  and  variance  v(4>2)  <  /./  >2  (cf.,  (16)). 

Then,  for  {/?*,  k  >  0}  €  77,  as  r  — ♦  00 

k^O 

converges  weakly  in  D[0,oo)  to 

w'w-=flT{iru>  <>o 

(Mandelbaum  and  Taqqu  (1984)). 

As  in  the  proof  of  Lemma  2,  the  Skorohod-Dudley  theorem  and  the  result  on  p.  221 
of  Resnick  (1987)  yield 

“  *■  -  °° 

To  complete  the  proof  of  Theorem  2  we  have  to  show  that 

WY{h)  =  M'(h)  (20) 

From  (10)  and  the  independence  of  Y  and  Ix  it  follows  that  Jx{d)  is  equal  in  distri¬ 
bution  to  s/YIx(<f>)  =  /,(v/F (j>)  (the  latter  is  defined  on  the  product  of  probability 
spaces),  and  K{<f>)  =  Y v(<f>2)  =  v  ((\/F<^)2).  In  particular,  for  the  random  measure' 
M  we  have 

m(b  x  [o,s])  =  jrxLek(iBi(M)  =  yF/rxLe6(iei[o.S])  =  /rMdfliio.,vi).  r^n 

The  last  relationship  follows  from  the  facts  that  V  is  independent  from  /{'xLc(>  and 
that  a  Gaussian  distribution  is  fully  determined  by  its  mean  and  covariance. 

We  complete  the  construction  of  the  multiple  integral  of  order  k  with  respect  to  the 
measure  M  on  an  arbitrary  measurable  space  as  follows.  The  comparison  of  the 
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generating  functions  for  ./*  and  /*  for  d»  £  L ,  yields 

YsjrJkihi)  =  exp{uJi(<f>)  —  ^-K(<i>)} 
k= o  A  •  z 

=  exp{u\/Y  1  \{<j>)  — yW($2)} 

fc= o  *• 

Thus,  we  define  Jk{l>k)  =  Yk^2h{hk)  for  /**  € 

Recalling  relationship  (21)  on  the  product  space  (A',-F,i/)  x  (R+,B[R+),  Lcb)  and 
the  definitions  of  IT  '  (/i)  and  M  (h),  we  conclude  that  (20)  holds.  This  completes 
the  proof  of  Theorem  2. 

Proof  of  Theorem  1.  Take  t  =  1  in  the  statement  of  Theorem  2.  Due  to  the 
Cramer- Wold  device  (Billingsley  (1968),  p.  49)  and  the  linearity  of  Z'(lt)  and  A/‘(/i) 
in  the  argument  /i,  Theorem  1  follows  if  we  prove  that  «/*xLe<,(^jk,i )  —  Jk{h-k)-  However, 
this  follows  immediately  from  the  definition  of  J*  via  /*  (see  proof  of  Theorem  2)  and 
the  relationship  / 1(<^>)  =  l(0,i])-  (Both  variables  are  Gaussian  with  mean  zero 

and  variance  i'(4>2)-)  This  completes  the  proof  of  Theorem  1. 

4  The  limit  theorems  and  random  fields. 

We  now  return  to  the  particle  picture  described  in  the  Introduction.  Let  Zj  :  =  {n  : 
n  =  (?)j, . . .  ,nd)},  i.e.  the  set  of  all  d-dimensional  integer- valued  multi-indices.  For 
each  n  €  Zj  let  C„  be  the  d-cube  defined  by  C„  =  {x  €  Rd  ■  —  1  <  -T.  < 

n,.t  =  1, . . .  ,d}.  Let  pt(x,y)  =  pt(y,x),  x,y  €  R?,t  >  0  be  a  symmetric  Markov 
transition  density  function  satisfying  //?<<Pt(x,y)dy  =  1  for  each  x  £  Rd  Let  g  be  t  he 
corresponding  Green’s  function 

fOO 

s(x,y)  =  /  e_<p,(x,y)dt.  (22) 

Jo 

On  a  probability  space  (fl,.F,  P),  define  an  infinite  collection  A  =  {An(<)^  >  0}n6zrf 
of  independent  symmetric  Markov  processes  on  R*  with  common  transition  densi¬ 
ty  l>t(r,y),  each  process  starting  according  to  a  uniform  distribution  in  Cn.  Fur¬ 
thermore,  let  the  probability  space  be  rich  enough  to  support  an  infinite  sequence 

A’i.A'j _ ,  A',, ...  of  such  collections,  all  independent  of  each  other.  If  A  is  one  of 

the  processes  in  the  entire  collection  (when  both  n  6  Zj  and  i  >  0  vary),  then  we  can 
think  about  it  as  describing  the  movement  of  a  particle  in  the  system. 
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We  take  (on  I  lie  same  probability  space)  a  sequence  of  collections  n, 

{<7,  n.v  6  Z,j)  of  independent  Radcmachei  variables,  i.e.  -  Ij  -  l’(n,,. 

—  1)  =  1/2.  VVe  can  think  about  crt>ri  as  a  positive  or  negative  "charge’  associated 
with  the  Markov  particle  A,iU.  For  additional  motivation  of  this  choice  of  “positive 
and  “negative”  particles  we  refer  to  Adler  (1989). 

Extend  the  probability  space  to  support  a  random  variable  /V(r).  r  >  0,  independent 
of  the  A"’s  and  o' s  and  such  that  (2)  holds.  ./V(r)  represents  the  number  of  collections 

A, . V ^/(r)  in  the  system  at  the  initial  time  t  =  0.  We  now  describe  the  evolution 

of  the  system  in  time.  When  a  particle  with  charge  a  at  time  1  passes  through  a 
point  .r  in  the  space  /?rf,  it  leaves  there  a  charge  c~la.  Let  A  6  &{Rd)  be  a  Borel  sei 
in  the  space  R'1 .  We  are  interested  in  finding  the  amount  of  charge  left  in  A  after  all 
particles  have  lost  their  charge  and  in  the  limit  of  increasing  initial  particle  density, 
i.e.  we  would  like  to  find  a  limiting  distribution  of 

1  NX]  r°° 

*r(A)  :=tEE/  <7>,nc-l\A(XtJt))dt  (Ai) 

n  J<> 

as  r  -*  oc.  More  generally,  consider  a  bilinear  form 

<  f,h  >=<  f,h>9:=  [  \  f(x)g(x,y)li(y)dxdy, 

J  Jr ™ 

where  g  is  given  by  (22).  Define  the  class  of  functions 

Sj  =  Sd(g)  :={/:/  on  Rd  with  <  |/|,  |/|  >  <  oo}. 


VVe  study  the  weak  convergence,  as  r  — *  oo,  of  the  finite  dimensional  distributions  of 
the  sum 


*r(/) 


ifEr 

v/^r-Zo 


<7i,nC  f{Xi,n(t))dt 


(24) 


Define  on  some  probability  space  a  generalized  random  field  {$(/),/  €  <5d}  1  his 

means  (cf.  Walsh  (1986),  p.  332): 


(a)  $( af  +  bit)  =  a<I>(/)  +  b$(h)  a.s.  for  all  f,h  €  Sd,  i.e.  $  is  a  linear  random 
functional; 

(b)  <I>  has  a  version  with  values  in  the  dual  space  S'd. 


Corollary  4.2  of  Walsh  (1986),  shows  that  in  order  to  assure  (b).  4>  has  to  be  contin¬ 
uous  in  probability.  We  specify  the  distribution  of  $  via 

EexP{,MU))  =  Cy  (^A2  <  /,/  >)  (26) 
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Lemma  5.  A  lin<‘ar  random  functional  <J>  with  distribution  {'Jo)  is  cunt  mn< in'-  in 
probability  on  >',/• 

The  proof  of  Lemma  5  is  postponed  to  the  end  of  the  section. 

Theorem  3.  As  r  — ►  oo,  the  finite  dimensional  distributions  of  the  field  { 4>r  (/ ) ,  /  £ 
Sd)  converge  weakly  to  those  of  the  field  {$(/),/  £  5d} . 

We  will  give  the  proof  of  Theorem  3  later. 

The  limit  theorems  developed  in  Section  2  allow  us  to  build  multiple  integrals  of  the 
field  <!>(/).  To  see  this,  consider  k  Markov  processes  A\, . . . ,  A*  from  the  system. 
Define 

roo  roo 

Fh(.  Y„...,A'*):=  /  ...  e'l'--t*fk(Xl(tl),...yXk(tk))dti...dtk  (2(») 

Jo  Jo 

for  each  function  fk  from  the  space 

Sj  =  Sj(j)  :=  {/»  :  A  on  with  <  |M,|M  X  oo). 

where 

<  .fk,h fc  >'.= 

/  JR™k  M Xl '  •  •  •  ’  x*)0(xi » yi )  •  •  •  (*fc»  y*)Myi>  •  •  • ,  y*)<k  i  •  •  •  ^^yi  •  ■  •  'y* • 

We  study  the  limiting  distribution,  as  r  — »  oo,  of  the  sum 


UM  ■■=  Cll'Y.  ■ 

'  ’  ^K.1<...<i*<Af(r)^‘(A,>  ’  ’  •  ’  ’  X,k  ^ 

(27) 

Ftjx . ,*.):=£. 

•  •  °U.ni  •  •  •  ^fki^b  .”1 1  i  ) 

nk 

(28) 

Theorem  4.  As  r  — ♦  oo,  the  finite  dimensional  distributions  of  the  pair 
<  4>r( /),  T(.fk )  >  on  Sd  x  converge  weakly  to  the  finite  dimensional  distributions 
of  the  pair  <  ${f),(\/k\)'l!(fk)  >,  where  V(fk)  is  the  multiple  integral  of  order  k 
associated  with  the  field  J\{f)  =  $(/). 

Proofs  of  Theorems  3  and  4  are  based  on  Theorem  1  and  the  following  lemma: 

.  * 

Lemma  6.  Let  fk,hk  £  Sd.  The  functional  Ffk  of  (28)  is  square-integrable  and 

EFjkFtn.  =  <  fk,hk  >  . 

Proof.  For  simplicity,  take  k  =  1.  For  f,h  £  Sd 

EFjFh  =  E  £an  [°°  e-tf(Xn(t))dt'£°rn  (°°  e-h{.Xm[s))ds  (29) 

J0  m  J° 
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Since  o  „.nul  are  independent  ami  with  zero  mean  E  rrnrjlu  —  bn„,  ami  l'2‘t)  e  «  •  j  ti.i  I  lo 

e  E I  P  nxn(i))h(xn(s))dtds  =  m 

2  f  [  e-'-’dldsT  f  da  f  pt(a,x)f(x)dx  f  ps-t(x,y)h(y)dy. 

Jo  Jt  „  Jcn  Jftd  Jr* 


Note  that.  pt(a,x)  =  p((.r,a), 


and  that. 

2  /  f  e~l~sps_t(x,y)dtds  =  g(x,y). 

Jo  Jt 

Thus,  (30)  is  equal  to 

[  (f{x)9(*,y)h(y)dxdy=<f,h>. 

J  JR2d 

The  proof  for  general  k  >  1  follows  from  similar  arguments  involving  longer  formulas 
but  no  new  mathematics  and  we  feel  free  to  omit  it.  Lemma  6  is  proved. 

Proof  of  Theorem  3.  Let  the  space  X  =  ((Rd)R+  x  {  —  1, 1})  “  be  the  path  space 

of  pairs  (A  ,  d),  and  denote  by  v  the  probability  measure  the  above  pair  induces  on 
X.  Then  by  Lemma  1  the  finite  dimensional  distributions  of  the  sum  (24)  converge 
weakly  to  those  of  the  field  Jx(Fj),  which  is  determined  by 

Eexp{iXMF,)}  =  Cr  (5 . 

However,  v(Fj)  =  EFj  =<  /, /  >  by  Lemma  6.  Thus,  {J\{Fj),f  €  Sd}  = 
€  5<y}.  This  completes  the  proof  of  Theorem  3. 

Proof  of  Theorem  4.  Let  X  and  u  be  as  in  the  proof  of  Theorem  3.  Theorem  4 
follows  immediately  from  Theorem  1,  noticing  that  {Ji(Fj),f  €  $d)  =  {$(/),/  6 
S'rf}  and  so  that  also  Jk  =  ty. 

It  follows  from  the  above  theorems  and  Examples  1-6  of  Section  2  that: 

(i)  If  N{r)  is  a  Poisson  r.v.  with  mean  r,  the  random  field  {$(/),  /  €  S'd }  is  a  centered 
Gaussian  with  covariance  E  $(f)$(h)  =<  f,g  >.  (This  is  the  case  studied  by  Adler 
and  Epstein  (19S7).) 

(ii)  If  N(r)  is  a  geometric  r.v.  with  mean  r,  the  random  field  {<!>(/),  /  €  5<<}  has  the 
Laplace  distribution 


Hj  Pi(x^a)dx  =  ] 


Thus,  (30)  is  equal  to 


Ecxp{i\$(f)}  = 


i  +  p»  </,/>• 
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(iii)  If  A  (r)  is  a  discretized  stable  r.v.,  as  defined  in  (fi),  1. 1 1 < •  random  field  {<Jm/ i.  /  ■ 
S,t }  is  a  generalized  stable  random  field  with  distribution  given  by 

We  similarly  obtain  random  fields  whose  marginal  distributions  include  the  t-distri 
bution,  Gamma  distribution,  and  others. 

Our  last  proof  is  of  Lemma  5: 

Proof  of  Lemma  5.  Because  4>  is  linear,  it  is  enough  to  prove  that 

^(/J  0  as 

Take  t  >  0.  For  any  8  >  0  take  N  large  enough  so  that  P(Y  >  A  )  <  6/2  and  n  large 
enough  so  that  <  /„,/„  ><  6e2/2N.  Then  from  the  relationship 

♦(/,)  =  MF,)ZSPh(F,), 

(I\{Ff)  is  a  centered  generalized  Gaussian  random  field  indexed  by  /  €  Sj  with 
variance  E{l\{Fj))2  —<  /, /  >)  and  from  the  Chebychev  inequality  it  follows  that 
^’(|<J>(/n)|  >  c)  <  6.  The  Lemma  is  proved. 


5  Other  initial  distributions. 


The  results  of  Section  2  can  be  interpreted  via  point  process  terminology  (cp..  Dynkin 
and  Mandelbaum  (1983),  p.  742):  a  sample  c^n  be  viewed  as  a  mixed 

empirical  point  process  defined,  for  example,  in  Karr  (1991),  p.  7.  Of  course,  if  N(r)  is 
Poisson,  we  have  a  Poisson  point  process.  Theorem  1  then  says  that  some  functionals 
represented  as  multiple  integrals  with  respect  to  the  random  measure  M  (given  by 
(4))  are  approximated  by  the  functional  (3)  of  the  mixed  empirical  process.  Similarly, 
Theorems  3  and  4  state  that  the  generalized  random  field  and  its  multiple  integrals 
can  be  approximated  by  functionals  of  the  point  process  on  the  path  space  of  cadlag 
functions,  which  is  constructed  in  Section  4.  If  instead  we  consider  a  mixed  empirical 
point  process  on  the  path  space  we  get  the  following  result: 

Proposition  1.  Let  Xt,  i  =  1,2,...,  be  Markov  processes  as  in  Section  4,  but  with 
initial  probability  measure  fi.  Let  N(r)  be  as  in  Section  4.  Define  the  following 
functionals  of  the  processes: 


1  NX]  /- 

<M/)  =  4=  £  /  <7, e-‘/(.Y, (<))<*< 

\r  Jo 


(31) 


1G 


+  •(/.)  :=--‘'T---E 


!<■,<  <i4<.V(>) 


’.J-'jJX: 


\„  I 


l  V* , 


where  the  functional  f)k  was  defined  in  (26).  Let  {4 >(/),/  £  Sh]  he  the  generalized 
random  field  whoso  distribution  is  specified  via  (25)  with  <  /,/  >  replaced  l>\ 

<  ft  /  >„:=  2  /  u(da)dxdyf(x)J(y)g{2)(a>x)g(.r.y):  (33) 

JR3d 

roo 

g(2](x,y):=  /  c~2tp,(x,y)dt. 

Jo 

Then,  the  statement  of  Theorem  4  holds. 

Proof.  As  in  the  proofs  of  Theorems  3  and  4,  we  apply  Theorem  1  to  a  sample  living 
on  the  product  of  the  path  space  of  the  Markov  processes  and  {-1,1}.  We  only  have 
to  establish  that  EFj  is  given  by  formula  (33). 


/*oo  roo 

Eh  k  =  o<: 

2  f  j  e~‘~'dtds  f  u(da)  f  p, (a, x)f(x)dx  f  ,y)I(y)dy. 

Jo  Jt  JRd  Jr*  Jr<i 

Making  the  change  of  variables  t  =  u,s  —  t  =  v  gives 


2  Jo  Jo  e  2U  '’dudv  J^PW  JRdP»(a,*)f(x)dx  JRdPv{*,y)f{y)dy. 

Using  Fubini  s  theorem  and  the  expressions  for  5  and  5U)  given  above,  we  obtain  the 
right  hand  side  of  (33).  This  finishes  the  proof  of  Proposition  1. 

Remark:  Following  Martin-Lof  (1976)  we  can  construct  a  stationary  mixed  empir 
ical  point  process  of  Markovian  particles  with  invariant  measure  r  x  Lebesgue.  In 
the  notation  of  Section  4,  this  would  correspond  to  the  case  where  the  numbers  of 
particles  in  each  cube  Cn  are  i.i.d.  random  variables,  each  distributed  as  A'(r).  (In 
the  construction  of  Section  4,  N(r)  has  the  same  value  for  all  cubes.)  We  conjecture 
that  a  limit  theorem  similar  to  Proposition  1  will  also  hold  in  this  case;  however,  this 
remains  to  be  proven. 


As  a  special  case  of  Proposition  1,  we  obtain  the  limit  for  functionals  of  the  processes 
which  constitute  a  Cox  point  process  in  the  path  space. 


Corollary.  Let  A ,,  1  =  1,2,...,  be  as  in  Proposition  1.  Let  A (r)  be  a  positive  random 
variable  independent  of  the  X,'s  such  that 


A  (r) 


v 


Y  as  r  — »  00, 


(35) 
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for  some  positive  random  variable  ) 

Let  l\  be  a  random  variable  such  that  conditioned  on  A.  I\  i>  Pois™>n  with  nnan 
A.  Then 


<M/)  :=  4=E  r°ie-lf{X,{t))dt  %  HI) 

*r(h)  :=  r"^. .  ^  •  ••"***<*., . Vlt)4  Y(/t), 


where  {$(/),/  €  .$'</}  is  the  generalized  random  field  with  distribution  given  in  Propo¬ 
sition  1  and  {ty(fk),fk  €  Sfi }  is  the  multiple  integral  of  order  k  associated  with  <J> 

Proof:  Note  that  as  r  — >  oo, 


Pa  _  P\  A(r)  ^  y 
r  A  (r)  r 

Thus,  application  of  Proposition  1  with  Ar(r)  =  PA  completes  the  proof. 
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